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DETAILED ACTION 

Claims 11-21 are withdrawn from further consideration pursuant to 37 CFR 1. 142(b) as 
being drawn to a nonelected species, there being no allowable generic or linking claim. Election 
was made without traverse in the reply filed on 9/30/2003. 

Response to Arguments 

Applicant's arguments, see Amendment B, filed 6/17/2004, with respect to the 
rejection(s)of claim(s) 1-10 and 22-31 under 35 U.S.C 103(a) have been fully considered and are 
persuasive. Therefore, the rejection has been withdrawn. However, upon further consideration, 
a new ground(s) of rejection is made in view of Rekimoto. 

The applicant should note that examiner Matthew L. Rosendale is no longer the examiner 
assigned to this case. This action and all further actions will be handled by examiner James M. 
Hannett 

Claim Rejections - 35 USC § 103 
The following is a quotation of 35 U.S.C 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

1: Claims 1-10, 22-29, 31-38, and 40-51 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over USPN 6,567,068 Rekimoto in view of USPN 6,069,648 Suso et al. 
2: As for Claim 1, Rekimoto depicts in Figures 5 and 6 and teaches on Column 6, Lines 21- 
34 and on column 2, lines 57-67 a process of operating a display device (3) comprising the steps 
of: displaying a cursor and a plurality of icons on the display (the plurality of icons are viewed as 
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the different text options to select); moving the display device; sensing motion of the display 
device; based on the motion directed by the user, the icons are repositioned in the display until 
the fixed cursor is on a target icon of the plurality of icons; and the user can select the target 
icon.Rekimoto teaches that the display device can comprise a PDA, However, Rekimoto does 
not disclose that the PDA can comprise a camera. 

Suso teaches a mobile telephone comprising a camera housing between a display body 
and a control body. The mobile phone of Suso can be used for various purposes including the 
display of icons as shown in Figure 7, including thumbnail images 20. 

Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to provide a camera as taught by Suso with the PDA device of Rekimoto so 
that the user can capture and transmit images. 

3: In regards to Claim 2, Rekimoto only comprises a list of icons and a white background as 
shown in Figure 6. However, Official Notice is taken that it was well known to provide an image 
background to a computer display screen. By having an image as a background instead of a solid 
color, the icons appear to be fixed in space with regard to the background image on the display. 

Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to provide an image set as the background of the display device of Rekimoto 
so that the display area can be made visually appealing to the user by setting an attractive image 
as the background for the icons. 

4: As for Claim 3, Rekimoto teaches and depicts in Figure 5 that the user moves the display 
device to select the icons by showing different parts of the entire list of icons on the screen based 
on the direction in which the user moves the display device in free space. Therefore, by moving 
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the display device to the left to view icons in that direction, icons currently on the display screen 
are displaced to the right so that icons located in the direction in which the user is moving the 
display device may be scrolled onto the display screen. 

5: In regards to Claim 4, Rekimoto teaches a PDA in Figure 1 comprising a display device 
(3) for displaying a plurality of icons as shown in Figure 6. Rekimoto does not disclose that the 
display device of Figure 1 can be used as a viewfinder. 

However, Suso discloses a mobile telephone comprising a camera housing between a 
display body and a control body shown in Figure 7. The display body of Suso can be used as a 
camera viewfinder (18) for image preview of an object (Column 5, Lines 33-62) 

Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to provide a PDA camera phone comprising the viewfinder as taught by 
Suso with the PDA display device of Rekimoto so that the user can preview an object before 
image capture to ensure a high quality image. 

6: As for Claim 5, Rekimoto teaches on Column 2, Lines 57-65 a non-optical motion 
detector such as a tri-axial gyroscopic sensor incorporated in the PDA display device. 
7: In regards to Claim 6, Rekimoto teaches that the display device can comprise a PDA as 
shown in Figure 1 . However, Rekimoto does not disclose that the PDA comprises a camera. Suso 
discloses a mobile telephone comprising a camera housing between a display body and a control 
body as shown in Figure 7. Suso does not disclose an optical motion detector. However, official 
notice is taken that optical motion detectors are well known in the art for sensing motion in a 
camera. 
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Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to provide a conventional optical motion sensor with the PDA camera phone 
display device of Rekimoto in view of Suso so as to provide a means of detecting the user 
moving the display device to select a target icon. 

8: As for Claim 7, Rekimoto does not disclose that the display icons are thumbnail images 
displayed on the PDA. 

Suso discloses that it is well known to provide a mobile phone having a display portion 
for viewing icons such as thumbnail images. As shown in Figure 7 of Suso the mobile phone 
disclosed therein can be used for various purposes including the display of icons including 
thumbnail images 20. 

Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to provide the thumbnail image display of Suso with the display device of 
Rekimoto so that the user can set a variety of icons as the target icons including thumbnails to be 
selected for full screen display. 

9: In regards to Claim 8, Suso teaches that a high resolution image can be displayed on the 
display portion corresponding to a thumbnail image selected by a user. However, Suso does not 
teach any image manipulation performed on the high quality image. Official Notice is taken that 
it is well known to provide image processing inside a camera so that captured images can be 
corrected for white balance, gamma, tone, black spot etc. 

Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to provide any known image processing means in the camera of Suso so that 
selected images that the user intends to keep could be processed to produce a finished image. 



Application/Control Number: 09/484 5 667 Page 6 

Art Unit: 2612 

10: As for Claim 9, Suso Further teaches that captured images may be transmitted to an 
external device via the transmitter on the phone portion of the camera (Column 7, Lines 37-49). 
11: In regards to Claim 10, Rekimoto further teaches on Column 6, Lines 21-56 that when 
the user selects the target icon, it activates or starts the program associated with the icon. 
12: As for Claim 22, Rekimoto depicts in Figures 5 and 6 and teaches on Column 6, Lines 
21-34 and on column 2, lines 57-67 a process of operating a display device (3) comprising the 
steps of: Displaying a cursor and a plurality of icons on the display (3) (the plurality of icons are 
viewed as the different text options to select); Moving the display device, sensing motion of the 
display device; Based on the motion directed by the user, the icons are repositioned in the 
display until the fixed cursor is on a target icon of the plurality of icons; and the user can select 
the target icon. Rekimoto teaches that the display device can comprise a PDA as shown in Figure 
1 . However, Rekimoto does not teach that the PDA can comprise a mobile phone and a camera. 

Suso discloses a mobile telephone comprising a camera housed between a display body 
and a control body. The mobile phone of Suso can be used for various purposes including the 
display of icons as shown in Figure 7, including thumbnail images 20. 

Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to provide a camera and phone transmitter as taught by Suso with the PDA 
and display device of Rekimoto so that a user can capture and transmit images. 
13: In regards to Claim 23, Rekimoto teaches on Column 7, Lines 9-48 determining a 
viewport for displaying a region of a given image based on the sensed motion of the user. 
14: As for Claim 24, Rekimoto depicts in Figure 6 that the given image can comprise a 
collection of target icons. 
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15: In regards to Claim 25, Rekimoto depicts in Figure 5 and teaches on Column 6, lines 28- 
34 presenting different regions of the given image containing subsets of icons in accordance with 
the determined viewpoint based on the motion directed by the user. 

16: As for Claim 26, Rekimoto depicts in Figure 5 and teaches on Column 6, lines 28-34 that 
based on the motion directed by the user, the icons are repositioned in the display until the fixed 
cursor is on a target icon of the plurality of icons; and the user can select the target icon. 
17: In regards to Claim 27, Rekimoto teaches a plurality of icons for selecting application 
programs and does not disclose the use of selecting thumbnail images. 

Official Notice is taken that thumbnail images are well known in the art as a means of 
displaying compressed image data. Therefore, it would have been obvious to provide selectable 
thumbnails with the display device of Rekimoto so a user can view multiple compressed images 
then select a desired image to be viewed at a higher resolution. 

1 8: As for Claim 28, Rekimoto discloses on Column 6, Lines 28-34 that the motion of the 
display by the user is tracked and used to reposition the image comprising sets of icons on the 
display. 

19: In regards to Claim 29, Rekimoto discloses on Column 5, Lines 18-43 that the motion of 
the display by the user is interpreted to determine a sequence of regions for the given image 
comprising a plurality of icons to present on the display reflecting the tracked motion of the 
display device. A sequence of regions is displayed on the display in correspondence to the user's 
motion of the device. 

20: In regards to Claim 3 1 , Rekimoto depicts in Figures 5 and 6 and teaches on Column 6, 
Lines 21-34 and on column 2, lines 57-67 a process of operating a display device (3) comprising 
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the steps of: Displaying a cursor and a plurality of icons on the display (3) (the plurality of icons 
are viewed as the different text options to select); Moving the display device; sensing motion of 
the display device; Based on the motion directed by the user, the icons are repositioned in the 
display until the fixed cursor is on a target icon of the plurality of icons; and the user can select 
the target icon. Rekimoto teaches that the display device can comprise a PDA as shown in Figure 
1 . However, Rekimoto does not teach that the PDA can comprise a mobile phone and a camera. 

Suso discloses a mobile telephone comprising a camera housed between a display body 
and a control body. The mobile phone of Suso can be used for various purposes including the 
display of icons as shown in Figure 7, including thumbnail images 20. 

Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to provide a camera and phone transmitter as taught by Suso with the PDA 
and display device of Rekimoto so that a user can capture and transmit images. 
21: As for Claim 32, Rekimoto teaches on Column 7, Lines 9-48 determining a viewport for 
displaying a region of a given image based on the sensed motion of the user. 
22: In regards to Claim 33, Rekimoto depicts in Figure 6 that the given image can comprise a 
collection of target icons. 

23: As for Claim 34, Rekimoto depicts in Figure 5 and teaches on Column 6, lines 28-34 
presenting different regions of the given image containing subsets of icons in accordance with 
the determined viewpoint based on the motion directed by the user. 

24: In regards to Claim 35, Rekimoto depicts in Figure 5 and teaches on Column 6, lines 28- 
34 that based on the motion directed by the user, the icons are repositioned in the display until 
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the fixed cursor is on a target icon of the plurality of icons; and the user can select the target 
icon. 

25: As for Claim 36, Rekimoto teaches a plurality of icons for selecting application programs 
and does not disclose the use of selecting thumbnail images. 

Official Notice is taken that thumbnail images are well known in the art as a means of 
displaying compressed image data. Therefore, it would have been obvious to provide selectable 
thumbnails with the display device of Rekimoto so a user can view multiple compressed images 
then select a desired image to be viewed at a higher resolution. 

26: In regards to Claim 37, Rekimoto discloses on Column 6, Lines 28-34 that the motion of 
the display by the user is tracked and used to reposition the image comprising sets of icons on the 
display. 

27: As for Claim 38, Rekimoto discloses on Column 5, Lines 18-43 that the motion of the 
display by the user is interpreted to determine a sequence of regions for the given image 
comprising a plurality of icons to present on the display reflecting the tracked motion of the 
display device. A sequence of regions is displayed on the display in correspondence to the user's 
motion of the device. 

28: As for Claim 40, Rekimoto discloses on Column 6, Lines 28-34 that the motion of the 
display by the user is tracked and used to reposition the image comprising sets of icons on the 
display. Rekimoto teaches a PDA in Figure 1 comprising a display device (3) for displaying a 
plurality of icons as shown in Figure 6. Rekimoto does not disclose that the display device of 
Figure 1 can be used as a viewfinder. 
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However, Suso discloses a mobile telephone comprising a camera housing between a 
display body and a control body shown in Figure 7. The display body of Suso can be used as a 
camera viewfinder (18) for image preview of an object (Column 5, Lines 33-62). 

Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to provide a PDA camera phone comprising the viewfinder as taught by 
Suso with the PDA display device of Rekimoto so that the user can preview an object before 
image capture to ensure a high quality image. 

Furthermore, Official notice is taken that it was well known in the art to have viewfmders 
for cameras to superimpose Icons over the image in order to convey Battery charge, Time, and 
other information to a user. 

Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to allow the viewfinder of Rekimoto in view of Suso to have icons 
superimposed over the image in order to convey battery charge, time, and other information to a 
user. 

29: In regards to Claim 41, Rekimoto depicts in Figures 5 and 6 and teaches on Column 6, 
Lines 21-34 and on column 2, lines 57-67 the different regions of the given image are displayed 
so that the icons appear fixed with respect to a coordinate system external to the camera (Figure 

1). 

30: As for Claim 42, Rekimoto discloses on Column 6, Lines 28-34 that the motion of the 
display by the user is tracked and used to reposition the image comprising sets of icons on the 
display. Rekimoto teaches a PDA in Figure 1 comprising a display device (3) for displaying a 
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plurality of icons as shown in Figure 6. Rekimoto does not disclose that the display device of 
Figure 1 can be used as a viewfinder. 

However, Suso discloses a mobile telephone comprising a camera housing between a 
display body and a control body shown in Figure 7. The display body of Suso can be used as a 
camera viewfinder (18) for image preview of an object (Column 5, Lines 33-62). 

Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to provide a PDA camera phone comprising the viewfinder as taught by 
Suso with the PDA display device of Rekimoto so that the user can preview an object before 
image capture to ensure a high quality image. 

Furthermore, Official notice is taken that it was well known in the art to have viewfinders 
for cameras to superimpose Icons over the image in order to convey Battery charge, Time, and 
other information to a user. 

Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to allow the viewfinder of Rekimoto in view of Suso to have icons 
superimposed over the image in order to convey battery charge, time, and other information to a 
user. This is viewed by the examiner as simultaneously presenting a virtual image (icons) and an 
image of a scene viewed through the camera (viewfinder image). 

31: In regards to Claim 43, Rekimoto does not disclose that the display icons are thumbnail 
images displayed on the PDA. 

Suso discloses that it is well known to provide a mobile phone having a display portion 
for viewing icons such as thumbnail images. As shown in Figure 7 of Suso the mobile phone 
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disclosed therein can be used for various purposes including the display of icons including 
thumbnail images 20. 

Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to provide the thumbnail image display of Suso with the display device of 
Rekimoto so that the user can set a variety of icons as the target icons including thumbnails to be 
selected for full screen display. Therefore, the Icons superimposed over the viewfinder image 
would be the thumbnail images. 

32: As for Claim 44, Rekimoto teaches on Column 7, lines 9-48 that a virtual map can be 
displayed on the display and that only a small portion of the entire map image is displayed on the 
display at any given time. Furthermore, the area of the image that is displayed is based on the 
movement detected by the motion sensors. This is viewed by the examiner as presenting 
different portions of a virtual panoramic image in a display in accordance with the interpreted 
user interface input, wherein the virtual panorama is composed of multiple images. However, 
Rekimoto does not teach the use of a camera and does not teach that the image that can be 
displayed on the display in accordance with the movement detected by the motion sensor can be 
an image captured by a camera. 

Suso teaches a mobile telephone comprising a camera housing between a display body 
and a control body. The mobile phone of Suso can be used for various purposes including the 
display of images as shown in Figure 7. 

Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to provide a camera as taught by Suso with the PDA device of Rekimoto so 
that the user can display the captured images. 
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33: In regards to Claim 45-47, Rekimoto teaches a method of using gyroscopic sensors to 
detect motion of an electronic device. Rekimoto teaches an improved Cursor/pointer system in 
which icons on a screen can be selected in accordance with the detected movement by 
gyroscopic sensors. Suso teaches a mobile telephone comprising a camera housing between a 
display body and a control body. The mobile phone of Suso can be used for various purposes 
including the display of images as shown in Figure 7. However, neither Rekimoto nor Suso 
teaches selecting a portion of the displayed image by designating boundaries of a region of a 
scene and storing the boundary region information for further processing. 

Official notice is taken that it was well know in the art at the time the invention was made 
to allow a cursor/pointer of an image processing system to be clicked and dragged across an 
image in order to allow a user to manipulate a sub-region of the image. 

Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to enable a user to click on the displayed image of Rekimoto in view of Suso 
and drag the cursor across the image in order to allow a user to manipulate a sub-region of the 
image. 

34: As for Claim 48-50, Suso teaches that a high-resolution image can be displayed on the 
display portion corresponding to a thumbnail image selected by a user. However, Suso does not 
the use of modifying the high quality image. 

Official Notice is taken that it is well known to provide image processing inside a camera 
so that captured images can be corrected for white balance, color balance, Cropping, red Eye 
removal defective pixel removal etc. in order to improve image quality. 
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Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to provide any known image processing means in the camera of Suso so that 
selected images that the user intends to keep could be processed to produce a finished image. 
35: In regards to Claim 51 , Rekimoto in view of Suso teaches the use of a PDA device that 
has a telephone and camera built in. Rekimoto teaches the use of a GPS system included in the 
PDA device and Suso teaches the use of a camera. However, Rekimoto in view of Suso does not 
teach the method of recording the time of day and geographical location data with each picture 
captured by the camera. 

Official Notice is taken that it was well known in the art at the time the invention was 
made that it was advantageous when capturing images to record the current time and if a GPS 
system is included the geographic location data in order to allow a person to later review the 
image and know where and when the image was captured. 

Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to allow the PDA camera of Rekimoto in view of Suso to record the current 
time and the Geographic location data with each image in order to allow a person to later review 
the image and know where and when the image was captured. 

36: Claims 30 and 39 are rejected under 35 U.S.C. 103(a) as being unpatentable over USPN 
6,567,068 Rekimoto in view of USPN 6,069,648 Suso et al in further view of USPN 5,861,916 
Sekine et al. 

37: As for Claim 30, Rekimoto detects motion of the PDA display device by using a 
gyroscope, and does not use sequential images due to the lack of an iamge capture means. 
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However, Sekine discloses a method of detecting a difference signal between first and second 
image signals used to detect movement in the image sensing device (Column 2, Lines 24-44). 

With the combination of Rekimoto and Suso where Suso provides an image sensing 
means, it would have been obvious to one of ordinary skill in the art at the time the invention 
was made to apply the motion detection method of Sekine and utilize the image sensing means of 
Suso to determine the motion of the display and image capture system of Rekimoto in view of 
Suso so that the motion sensing means disclosed by Rekimoto can be eliminated making the 
overall device design simpler with less parts. 

38: In regards to Claim 39, Rekimoto detects motion of the PDA display device by using a 
gyroscope, and does not use sequential images due to the lack of an iamge capture means. 
However, Sekine discloses a method of detecting a difference signal between first and second 
image signals used to detect movement in the image sensing device (Column 2, Lines 24-44). 

With the combination of Rekimoto and Suso where Suso provides an image sensing 
means, it would have been obvious to one of ordinary skill in the art at the time the invention 
was made to apply the motion detection method of Sekine and utilize the image sensing means of 
Suso to determine the motion of the display and image capture system of Rekimoto in view of 
Suso so that the motion sensing means disclosed by Rekimoto can be eliminated making the 
overall device design simpler with less parts. 

39: Claim 52 is rejected under 35 U.S.C. 103(a) as being unpatentable over USPN 6,567,068 
Rekimoto in view of USPN 6,069,648 Suso et al in further view of USPN 5,905,525 Ishibashi et 
al 
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40: As for Claim 52, Rekimoto in view of Suso et al teaches the use of a PDA camera that 
can display images based on the tracked motion of the camera by means of gyroscopic sensors. 
However, Rekimoto in view of Suso et al only teaches the use of one display and does not teach 
that the PDA camera device can have a first and second display which enable a user to perceive a 
stereoscopic pair of images. 

Ishibashi et al teaches in Figure 2 and on Column 3, Lines 32-67 and Column 4, Lines 1- 
52 that it is advantageous to allow people to view captured images using a stereoscopic headset 
in order to allow a person to perceive a 3D representation of a captured image. 

Therefore, it would have been obvious to enable the PDA camera of Rekimoto in view of 
Suso et al to output the captured image to a stereoscopic headset in order to allow a person to 
perceive a 3D representation of a captured image. 

Conclusion 

The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. USPN 5,602,566 Motosyuku et al teaches the use of an information processor capable 
of scrolling a screen in accordance with tilting the device. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to James M Hannett whose telephone number is 703-305-7880. The 
examiner can normally be reached on 8:00 am to 5:00 pm M-F. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Wendy Garber can be reached on 703-305-4929. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



James M. Hannett 

Examiner 

Art Unit 2612 



JMH 

September 1, 2004 
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